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Abstract 

In this paper the Random Energy Model(REM) under exponen- 
tial type environment is considered which includes double exponen- 
tial and Gaussian cases. Limiting Free Energy is evaluated in these 
models. Limiting Gibbs' distribution is evaluated in the double ex- 
ponential case. 

Key words: Spin Glasses; Random Energy Model; Double Expo- 
nential; Free Energy; Gibbs' Distribution. 



1 Introduction 

Usually the Random Energy Model ^ is considered in a Gaussian^' ^' ^> ^1 
environment. In this paper we discuss the same under a double exponential 
environment. It is interesting to note that in our analysis the distribution of 
Hamiltonian, Hjy does not depend on N. We use large deviation method^ 
to calculate the limiting free energy. There is a phase transition at (3 = 1 . 
The methods carry over to a more general exponential type family that 
includes the Gaussian case as well and we provide explicit formulae for the 
free energy. 

We use Talagrand's^l approach to obtain the limiting Gibbs' distribu- 
tion in the low temperature regime. It is interesting to note that the limit 
is again a Poisson-Dirichlet distribution. Observe that when X is double 
exponential with parameter one, E(e@ x ) does not exist for (3 > 1. For 
< f3 < 1 we obtain - as expected - uniform distribution as the infinite 
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volume limit of Gibbs' distributions. This is done via an interesting vari- 
ant of the strong law of large numbers. These methods carry over to the 
Gaussian case as well. 



2 Free energy 

For each configuration o G Sat = { — 1,1}^ of an N particle system, the 
Hamiltonian is Hn(<t). Since we are considering REM, {Hn(<j)} are i.i.d. 
In fact, we assume that they are double exponential, that is, have density 
(not depending on N) 

4>n(x) = xe - ' 21 ', — oo < x < oo. 



The partition function of the system is 

Z N {[3) = £yW") = 2 N V a e- N ?^, 

where [3 > is the inverse temperature and E CT stands for expectation w.r.t 
<7 when £jv has uniform distribution. Hence the free energy of the system 
is 

^logZ JV (/3)=log2+llogE ff e-^™. 
Now let fi j\[ be the induced (random) probability on R via the map 

H N (a) 

when T,n has uniform distribution. 

Proposition 2.1 /i^v <5o a - s - as N — > oo. 

That is, for almost every sample point, the sequence of random measures 
{Hn} converges weakly to point mass at 0. 

Proof: For any e > 0, define A(e) = [— e, e] C R. Now by Markov inequality, 

1 1 , _ 1 



P(n N (A c (e)) > e) < -E Mjv (A c (e)) < -P(\H N \ > eN) = -e 
Apply Borel-Cantclli. 
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Let A C R be an open interval. Put to — inf |a;| and M — sup \x\, 

and qjy = P(^$- € A). These quantities, of course, depend on A. Observe 
that A C (-M, -m] U [to, M), so that 

rNM roc 

q N < e- x dx < / e- x dx = e- Nm (1) 

JiVm J Nm 

and 

r jVM i r Nm+S 



QN 



> 



i /■JVM i i-ism+o r 

i/ e~ x dx>^ e- x dx>-e-( Nm+s \ (2) 

for any (5, (0 < <5 < M — to). Both (1) and (2) remain true even if to = 0. 

Proposition 2.2 If m > log2 ; t/ien almost surely eventually /i/v(A) = 0. 
Hence almost surely eventually, /ijv[— log 2, log 2] = 1 



Proof: By definition, 



/'Jv(A) = ^ 1 (A) 



Hence {mjv(A) > 0} = {Vl^fA) > 1}. Now by Chebyscheff's 

(7 

inequality, P(/ijv(A) > 0) < Eyi %M (A) = 2^^. 

JV 

(7 

Since to > log 2, (1) implies, P(/^at(A) > 0) < oo. Borel-Cantelli 

jV>l 

completes the proof. 

Proposition 2.3 If m < \og2, then for any e > a.s. eventually 
(l-e)q N < n N (A) < (l + e)q N . 

Proof: Note that 

var(ji N {A)) = E( MjV (A)) 2 -[E MiV (A)] 2 



yTTT > El ffiyW (A)I hjv(t) (A) - ^ 
^ — ' In n 

(r,r 

= oW / , | El H N (a) (A)l %(r) (A 

' — ' L jv jv 

a— t 

— 7 & w \^ ^ %H (A) 

jv 



5jY 



9jv 
2 jv 
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Hence for any e > 0, by Chebycheff's inequality 

P [|MA) - E MA r(A)| > eE Mw (A)] < 



e 2 2 N q 



N 



Using (2) and the fact to < log 2, we get ^2 N 2 N q N 1 < oo, so that 
P(|/ijv(A) — gjv| > c^at) < oo. Borel-Cantelli completes the proof. 

Propositions 2.3 and 2.2 combined with the inequalities (1) and (2) 
yield, 

Proposition 2.4 Almost surely, 

lim ^-\og(i N (A) = -to i/m<log2 

JV— >oo iV 

= — oo i/ to > Zog2. 

Now let us consider the map I : R — > R + , defined as follows, 

J(x) = |x| if — log 2 < x < log 2 
= oo otherwise. 

Theorem 2.1 Almost surely, the sequence {^n} satisfies the large devia- 
tion principle with rate function I. 

Proof: The collection A of open intervals with rational end points is a 
countable base for R. For A e A, put = — lim — log/xjv(A). Note 

AT— *oo N 

that, for a; e R Proposition 2.4 implies, /(x) = sup La- 

Since almost surely {^n} is supported on a compact set, Theorem 4.1.11 
of Dembo and Zeitouni® completes the proof. 

Theorem 2.2 For almost every sample point, 

lim llogZjvOS) - log 2 «/j9< 1 

N—>oo IV 

= /31og2 ifp>l. 

Proof: By Theorem 2.1, almost surely, the sequence {/xat} satisfies large 
deviation principle with rate function I. By Proposition 2.2, the sequence 
{^n} is supported on a compact set. Varadhan's lemma with h(x) = (3x, 
— oo < x < oo gives 

lim llogM/?) = log 2- inf {/i(x)+/(x)} 

AT— >oo iV i£R 

= log 2— inf {/3x+|x|| 

M<log2^ 

= log 2- inf (l-/3)x. 

0<rr<log2 
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Hence a.s. 

lim llogZjvOS) = log 2 if/3<l 

N—>oo iv 

= /31og2 if/3>l 

Remark 2.1 It is worth noting that the above consideration hold for a 
general class of distributions. More precisely, let a > 1 be fixed. For each 
N, consider {Hn(<t) 7 <j e £} to be i.i.d. with density 

|:c|° 

4>n(x) = C a ^M e , — oo < a; < oo, 

q-l 

where C a . N = (§) a . 

Of course, when N = 1, this reduces to the case considered above 
and for N — 2 this becomes the Gaussian case usually considered in the 
literature. For a > 1, similar calculations as above lead to the rate function 

I(x) = Ml if - (a log 2) £ < x < (a log 2) ^ 
= oo otherwise. 

and almost surely, the limiting free energy is 

lim l-logZ N (/3) = log2+^/3^T if ^ < ( a l og 2)^ 
= /3(alog2)H if /3 > ( a log 2)^ 

For a — 2, this coincides with the known formula®. Of course, when 
a = 1 the formula, interpreted in the limiting sense, is the one obtained 
earlier. 



3 Gibbs' Distribution 

We return to the double exponential environment. Recall that Gibbs' dis- 
tribution for the N particle system is the (random) probability on Sjv 
defined as 

e -/3H N (a) 

GN{a) = ^w> ae ^ N - 

We show that for (3 < 1, the (random) Gibbs' distribution Gat converges 
weakly to the uniform probability on { — 1,1} 00 almost surely. Uniform 
probability here means the product probability on { — 1,1} 00 where each 
coordinate space has probability. Since for each N, Gjy is defined 

on { — 1,1}^ the notion of convergence here is to be carefully understood. 
This is made precise in Theorem 3.1 below. 
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Theorem 3.1 Fix [3 < 1. Then almost surely, for any K > 1 and any 
a G { — 1, Pn(o~) — > as ^ ~~ * °°> w/iere p^v is the marginal of Gn 
on {-1,1} K . 

Proof: For < (3 < 1, define Z^(/?) - £ ff e-" ff »Wl { . flj<(t) < w} , where 
5 will be chosen latter depending on (3. 

Since P{-H N (a) > SN} < \e~ m , for any 8 > log2, Borcl-Cantclli 
implies that almost surely, eventually 

Z N (f3) = Z' N {{3). (3) 

Argument as in Proposition 2.3 and symmetry of distribution of Hjy 
lead to, 

P [\Z' N (f3) EZ' N (f3)\ > eVZ> N ([3)] < ^s^h^^ - ^ 
But, 

Ee^l {HN < 5N} > Y^Jj- (5) 

Now note that, 

Ee 2 " H -l {HN < SN} < if/3<± 

= ^ if/3 = i (6) 

In case < [3 < \ , we choose S > log 2 while for \ < (3 < 1 we choose 
5, log 2 < <5 < so t h a t by (5) and (6), (4) implies 

J2 P [\Z' N W) - EZ' N (f3)\ > eEZ' N (/3)} < oo. 

Thus, with the choice of 5 as specified above, Borel-Cantelli implies that 
almost surely eventually, 

(1 - e)EZ' N (f3) < Z' N (f3) < (1 + e)EZ' N (f3). 

Combining this with (3) we have almost surely eventually, 

(1 - e)EeWl {HN < SN} < ^ < (1 + e)Ee^ H »l {HN < SN} . 

Now fix K > 1 and a e {-1, 1} K . Let Y N = ^ e -/3*M</) ; whcre the 

sum is over all a' G {—1, 1}^ that extend a. 
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Argument similar to above shows that, with the same 5, almost surely 
eventually, 

(1 - e)Ve^ H »l {HN < SN} < ^ < (1 + e )Ee 2 ^l {H „< 5JV} . 

As a consequence, almost surely eventually Pn{°~), which by definition is 
-Tj^gy, lies between 2~ K and 2~ K completing the proof. 

Remark 3.1 Clearly for the regime (3 < 1 the argument shows directly 
that almost surely log Zjy((3) — > log 2. 

Remark 3.2 Returning to Remark 2.1, if we consider the environment 
parametrized by a, it is in general difficult to evaluate the limiting Gibbs' 
distribution. However for a = 2, our arguments lead to the convergence of 
Gibbs' distribution to the uniform probability, in high temperature regime. 
(See appendix for details.) 

Remark 3.2 Hidden in the above argument is a variant of the strong law 
of large numbers, which will be taken up elsewhere. 

To study the Gibbs' distribution for (3 > 1, since multiplicative con- 
stant cancels out, instead of H N (a) we use the random variables H' N (<r) — 
Hn{o~) + cln, where a N = (N — 1) log 2. Mimicking the proof of Lemma 
1.2.2 of Talagrandl 8 ! yields, 



Proposition 3.1 For 6eR, 



lim P(#{«r : -H' N (a) > b} = k) = „ 

N^oo fc! 

Moreover, if 3 exactly k many a 1 , ■ ■ ■ , cr k in Sjv such that ~H' N (a l ) > b 
then for large N these k points are distributed like {X\, • • • , where Xi 's 
are i.i.d. with density e - (* -b )l{ t >b}. 

Proof: For fixed b € R and N so large that b + ajy > 0, define 

1 f°° 1 

d N {b) = P(-H' N (a)>b) = - e- {x+aN Ux = -e-<- b+aN K (7) 

2 Jb 2 

By definition of clearly, 2 N dN(b) = e~ b . Since #{er : —H' N (a) > b} 
is Binomial with parameters 2 N and c?at, Poisson approximation of the 
binomial completes proof of the first part. 

The last part of the proposition follows from the fact that H'^s are 
i.i.d. and by (7), have density proportional to e~(* +a ")l{ t > & }. 
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Let m > and LT be the Poisson point process on (0, oo) with intensity 
x~ m ~ 1 dx. Then almost surely, II consists of summable sequences and hence 
can be arranged in decreasing order (7r(l), 7r(2), • • •). Let <S'(7r) denotes the 
sum The distribution of (;^y : i > 1) is denoted by PD(m, 0), 

called Poisson-Dirichlct distribution with parameter m. For more details 
and a two parameters family see Pitman and Yor^. 

Proposition 3.2 Consider a Poisson point process on R with intensity 
e~ x dx, and (cj)j>i an enumeration in decreasing order of these Poisson 
points. Then the sequence 

e^ 

has distribution PD(^,0). 

Proof: If (cj) are Poisson points on R with intensity e~ x dx 1 Ui = Ke^ Ci , 
where K = 0@, then (uj) arc Poisson points on (0,oo) with intensity 
x~~$~ x dx. Clearly if (q) are enumerated in decreasing order then so are 
(ui). Since Vi = iti/Ej u j, we conclude that (vi) follows PD(^,0). 

Let S be the set of all decreasing non-negative sequences with sum at 
most one. With the I -metric d{x,y) — E \x% — Ui\, where x = (xi) and 
V = {Ui)i S is a Polish space. Now let w = (u>i)i>i, where (u>i)i<2« is the 
non- increasing enumeration of the (random) Gibbs' weights {Gn(o-) : a e 
Sat} with Wi — for i > 2 N . Let ^jv be the law of w on 5. Let /i be the 
law of v = (vi)i>i of Proposition 3.2 on S. 

Theorem 3.2 Let [3 > 1. T/ien ^ijv =!> /i oi 5, t/iat is, i/ie Zaw o/ tt) 
converges to PD(^,0) as N — > oo. 

Proof: One has only to adapt the proof of Theorem 1.2.1 in Talag rand^. 
At the suggestion of the referee we give a brief outline. Fix / uniformly 
continuous function on S, bounded by one and e > 0. Suffices to show 
| J fdfi N — j fdfj,\ < e for all large N. 

Let (c^ be as in Proposition 3.2. Recall that a N = (N — l)log2 and 
H'n ( a ) = Hn (c) + a N . For fixed b € R, Put temporarily, 

Zn(P) = E CT e-^ (<7) , 

= E CT e-^ (<7) l{-^(a)>6}, 

w * = 2OTy 1 {/»*>t} lf «'i = OTy. 
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Denote w b = {w b )i>\ and v b — {v b )i>\. Let n. b N (respectively, u. b ) be the 
law of w b (respectively, v b ) on S. Observe, 



| / fdfl N - J fd»\ < | / fd m - J fd^ b N \ + | / fdfl b N - J /VI 



Firstly, we show that for given S > 0, there exists bo (depending on (3 
and S) such that for b < bo, 

( Z N {f3)-Z N {[3,b) \ 

T-™ pP l — ^ — (9) 

Then, using d(w,w b ) — 2 Zjv ^m^)^ anc ^ that / * s bounded and 
uniformly continuous, the first term on the right side of (8) can be made 
< | for all large N. To see (9), we proceed as follows: 

Since Z N {f3) < e? x => {#{cr : -H N (a) > x} = 0}, by Proposition 3.1, 
lim P(#{cr : —Hm{<j) > x} = 0) = e~ e , so there exists 77 > such that 

N^cc 

for large N, 

P(Zn(0) <V)<1- (10) 

Again, for fixed x € R with N so large that x + > 0, E(Zjv(/3) — 
Z N (/3,x)) = pzjeO 3 - 1 ^ - -^e^^- 1 ^". Since > 1 this can be made 
sufficiently small by an appropriate choice of large negative quantity x and 
large N. So that, by Chebycheff's inequality, we can get 60 (depending on 
77, S, (3) such that for b < b and large N, 

P[Z N (p)-Z N ((3,b)>r]6}<^ (11) 
Now (10) and (11) imply (9). 

Secondly, the last term in (8) can be made small by choosing b large 
negative quantity since /i fc => \i as b — > —00. Fix now such a number b. 
There is no loss to assume (9) also holds. 

Finally, the middle term in (8) can be made arbitrary small by choosing 
N large, since by the last part of Proposition 3.1 fi N => fi b . 

Thus for large N each of the three terms on the right hand side of (8) 
can be made smaller than |. 



Appendix 

Proposition: Consider REM with Hm ~ Gaussian (0, N) and fix < 
[3 < \/2 log 2. Then almost surely, for any K > 1 and any a G { — 1, 1} K , 
Pn(o~) — > 2^" as N ~ > where is the marginal of Gm on {—1, 1} K ■ 
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A stronger version with a difficult proof is in Talagrandl 8 !. The purpose 
of this appendix is to explain how the techniques used in Theorem 3.1 above 
apply to this case. 

For < < V21oi2, define Z' N {(3) = T.^^^M-h^ksn}, 
where 5 will be chosen latter depending on (3. 

Since P{-H N (a) > SN} < -^e"^, for any S > V^gl, Borel- 

Cantelli implies that almost surely, eventually 

Z N ((3) = Z' N {{3). (12) 

Just as in Theorem 3.1, we have, 

P [\Z M - EZ> M > eVZM] < -—-^-ig^- . (13) 



Since 5 > log 2 > (3, 

*e^l {HN< _ SN} = ^=1^ e~^ dx > -e-. (14) 
Now note that, 

V2ttN J(2t3-8)N 

Thus, 

Ve^l {HN < SN} < if/3<§ 



< L_ e (25/3-V)^ if/3> 

- (2/3-<5)v / 2^/V 



(15) 



In case < (3 < y/\og 2, we choose <5 = 2-\/log 2 so that /3 < | and hence 
by (14) and (15), (13) implies 

E P [\Z' N (p) EZ' N ((3)\ > eVZ' N {(3)] < 4, E e^^ 2 ^ < oo. 

JV>1 £ W>1 



In case vk>g2 < (3 < y/2 log 2, one observes that \/2 log 2 < 2/3 — 



v /2(/3 2 - log 2) so that we can choose (5 e (V21og2, 2/3 - ^2(/3 2 - log 2)). 
With such a choice, (3 > | and again by (14) and (15), (13) implies 

E P N^O 9 ) - EZ ^^)l > ^O 9 )] < «>■ 

JV>1 

Thus in either case, if 5 is chosen as specified, Borel-Cantelli implies that 
almost surely eventually, 

(1 - e)EZ' N (J3) < Z' N {(3) < (1 + e)VZ' N {(3) 

and the proof is completed by repeating the same argument of Theorem 
3.1. 
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